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OBJECTIVE 

The  purpose  of  this  test  was  to  compare  the  human  visual  detection  of  military  targets  in  the  TARDEC 
Visual  Perception  laboratory  (VPL)  with  human  detection  performance  in  the  field.  The  data  used  were  slides 
that  were  taken  as  part  of  a  laser  protection  test.  This  is  an  example  of  dual-use  data,  a  good  way  to  save 
resources. 

VPL  PROCEDURAL  SETUP 

The  test  subjects  were  positioned  in  front  of  the  rear  projection  screen  in  the  car  buck  that  we  used  for 
the  first  phase  CRDA  with  GM.  The  Kodak  Ekta-Pro  slide  projector  was  placed  behind  the  screen. 

The  distance  from  the  screen  to  the  subject  was  259cm.  The  AAV  (Assault  Amphibian  Vehicle)  in 
image  4-1  was  used  to  check  the  distance  from  the  projector  to  the  screen.  The  actual  length  of  the  AAV  is 
7.943m  and  at  a  distance  of  1  km,  the  vehicle  is  0.0078  radians.  With  the  subject  to  the  screen  distance  of  259 
cm,  the  AAV  size  was  2  cm  high  on  the  screen.  The  projector  was  placed  so  as  to  project  the  correct  size  of  the 
AAV. 

TESTING  METHODOLOGY 

Using  the  slide  projector  a  total  of  21  slides  were  arranged  according  to  the  field  show  number.  The 
VPL  was  dimmed  except  the  projector  light  and  recording  lamp  light. 

Subjects  were  instructed  to  point  out  the  location  of  the  target  and  name  what  type  of  vehicle  he/she 
thought  it  was.  Each  slides  was  shown  to  the  subjects  with  a  3  second  time  limit.  If  the  subject  wanted  to 
proceed  to  the  next  slide  within  the  time  limit,  the  next  image  was  shown. 

Hard  color  copies  of  slides  were  prepared  to  record  the  subject  responses.  Each  subject’s  response  was 
recorded  on  the  paper  corresponding  to  each  scene.  The  recording  was  done  such  that  the  position  of  the  targets 
and  the  name  of  the  targets  that  the  subject  pointed  out  were  recorded. 

SCORING  METHOD 


At  the  field  location,  the  correct  positioning  of  the  target  was  considered  an  identification.  In  the  VPL 
experiment,  just  pointing  out  the  target  and  correctly  naming  the  target  was  considered  as  identification. 

See  appendix  A  for  the  scoring  of  individual  responses.  _ 


Field 

LAB 

ID 

A  target  was  considered  identified  if  it  was 
indicated  in  the  correct  position  (grid  square) 
and  with  the  correct  target  name. 

A  target  was  considered  identified  if  it  was 
pointed  out  and  named  correctly. 

DET 

A  target  was  considered  detected  if  it  was 
indicated  in  the  correct  position  (grid  square) 
but  with  the  incorrect  target  name. 

A  target  was  considered  detected  if  it  was 
pointed  out  but  named  incorrectly. 

UN 

A  target  was  considered  undetected  if  it  was  not 
indicated  at  all. 

A  target  was  considered  undetected  if  it  was  not 
pointed  out  at  all. 

FA 

A  target  was  considered  a  false  alarm  if  it  was 
indicated  on  the  map,  when  actually,  no  target 
was  there.  An  example  of  a  FA  is  when  sage 
brush,  or  bushes,  are  mistaken  as  vehicles. 

A  target  was  considered  a  false  alarm  if  it  was 
pointed  out  which  is  bush  or  junk  pile  actually. 
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for  a  luminance  plot.  There  were  some  images  in  which  the  target  were  located  at  the  right  or  left  edge  of  the 
slide.  These  may  have  been  harder  for  the  subjects  to  search. 


DISTANCE  definition 

The  target  range  was  divided  into  bands  of  distance,  each  300  meters  deep.  The  entire  target  range  was 
3000  meters  deep  with  the  closest  target  at  600  meters  and  500  meters  wide.  The  distance  variable  is  referred  to 
as  DIST-1  through  DIST-8  and  the  specific  ranges  for  each  DIST  are  listed  below. 

DIST- 1 :  600  -  900  meters 
DIST-2:  900  -  1200  meters 
DIST-3:  1200  -  1500  meters 
DIST-4:  1500  -  1800  meters 
DIST-5:  1800 -2100  meters 
DIST-6:  2100  -  2400  meters 
DIST-7:  2400  -  2700  meters 
DIST-8:  2700  -  3000  meters 


AVAILABLE  DATA 

The  original  primary  purpose  of  the  field  test  was  to  compare  the  performance  of  the  laser  eye 
protection  systems  (1).  In  the  VPL,  only  the  baseline,  naked  eye  visual  perception  test  was  done.  The  ideal 
comparison  is  the  naked  eye  (lens  type  x)  field  results  with  the  VPL  results. 


RESULTS 

1)  LAB  DATA  and  NAKED  EYE  (Lens  type  X)  result  comparison 


a)  Lens  X  DIST  for  lens  type  x  field  test  result  vs.  all  subject  lab  data 


Field 

Lens 

Dist 

%ID 

%DET 

%UN 

1 

67.4 

5.8 

26.8 

2 

69.2 

9.1 

21.7 

3 

70.5 

9.4 

20.1 

4 

53 

12.8 

34.2 

5 

47.7 

19.5 

32.9 

6 

46.3 

24.8 

28.9 

7 

35.3 

19.3 

45.3 

8 

37.1 

16.1 

46.9 

LAB 

All 

Dist 

%ID 

%DET 

%UN 

1 

32.9 

36.9 

30.2 

2 

32.6 

40.6 

26.9 

3 

43.7 

47.3 

9.0 

4 

40.8 

45.4 

13.8 

5 

37.3 

49.6 

13.1 

6 

36.4 

43.3 

20.2 

7 

18.1 

53.3 

28.6 

8 

14.7 

38.7 

46.7 

3 


Correlation  values  Correlation  values 

From  dist-1  through  dist-8:  0.67  From  dist-1  through  dist-8:  0.58 

From  dist-3  through  dist-8:  0.85  From  dist-3  through  dist-8:  0.84 


b)  Lens  X  DIST  for  lens  type  x  field  test  result  vs.  lab  data  separated  by  scene  size 

Subject  response  was  divided  according  to  the  projector  distance  setup.  Subject  1-9  saw  smaller  target 
size  than  the  actual  size  but  in  brighter  image  than  the  second  setup  (subject  10  through  30). 


Correlation  value  of  %  ID  Subj.  1-9  Subj.  10-30 

From  dist-1  through  dist-8:  0.64  0.66 

From  dist-3  through  dist-8:  0.82  0.83 


c)  Lens  X  DIST  for  lens  type  x  field  test  result  vs.  lab  data  separated  by  the  20/20  and  higher  vision 
There  are  15  subjects  with  20/20  vision  and  15  subjects  with  higher  vision. 


Correlation  value  of  %  ID  Subj.  20/20  Subj.  better  than  20/20 

From  dist-1  through  dist-8:  0.7  0.64 

From  dist-3  through  dist-8:  0.87  0.82 
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d)  Lens  X  DIST  for  lens  type  x  field  test  result  vs.  lab  data  separated  by  the  normal  and  corrected  vision 
There  are  22  subjects  with  normal  vision  and  8  subjects  with  corrected  vision. 


Lab 

normal  vision 

corrected  vision 

- 1 

Dist 

■anal 

%UN 

mm 

1 

32.1 

40.6 

31.6 

mca 

28.1 

27.3 

2 

33.1 

39.7 

24.8 

ESI 

WVXM 

27.2 

3 

6.7 

47.7 

wnm 

10.4 

4 

47.0 

5 

18111 

40.3 

48.6 

14.0 

6 

■CfcT. 

43.0 

21.0 

7 

26.2 

46.8 

8 

44.0 

40.0 

girldl 

Lens  type  x  (field)  vs.  subject  w/  normal 


DIST 


-  Field  - 


Lens  type  x  (field)  vs.  subject  w/ 


DIST 


-Field  - 


-Lab 


Subject  w/  normal  vision  vs.  subject  w/ 


Correlation  value  of  %  ID  Subj.  normal 

From  dist-1  through  dist-8:  0.7 

From  dist-3  through  dist-8:  0.85 


Subj.  corrected  vision 

0.58 

0.84 


e)  Lens  X  DIST  for  lens  type  x  field  test  result  vs.  lab  data  separated  by  the  normal  color  and  color  blind 
There  are  28  subjects  with  normal  color  vision  and  2  subjects  with  color  blindness. 


Lab 

normal  color  vision 

color  blindness 

Dist 

%ID 

%DET 

%UN 

%ID 

%DET 

%UN 

1 

32.6 

36.7 

30.7 

36.7 

40.0 

23.3 

2 

31.7 

41.1 

27.2 

44.4 

33.3 

22.2 

3 

42.9 

48.3 

8.8 

55.9 

32.4 

11.8 

4 

39.8 

45.9 

14.3 

53.8 

38.5 

7.7 

5 

37.1 

49.3 

13.6 

40.6 

53.1 

6.3 

6 

35.5 

43.6 

21.0 

50.0 

40.0 

10.0 

7 

18.4 

52.6 

29.1 

14.3 

64.3 

21.4 

8 

14.0 

39.3 

46.7 

23.3 

30.0 

46.7 

Correlation  value  of  %  ID 


Subj.  normal  color  Subj.  color  blindness 


From  dist-1  through  dist-8:  0.67 

From  dist-3  through  dist-8:  0.84 


0.65 

0.84 


2)  Target  X  DIST  (for  all  lens  types)  vs.  Lab  data 


5 


5T0N  truck 


5TON 

Field 

Dist 

%ID 

%DET 

%UN 

1 

85.1 

1.2 

13.7 

2 

69.3 

10.1 

20.6 

3 

73.2 

10.7 

16.1 

4 

51.4 

18.1 

30.6 

5 

45.7 

18.3 

36.0 

6 

41.8 

16.4 

41.8 

7 

34.8 

23.2 

42.0 

8 

32.7 

18.2 

49.1 

5TON  Lab _ 

Dist  %ID  %DET  %UN 

1  40.8  30.8  28.3 

2  47.5  50.0  2.5 

3  47.3  47.3  5.3 

4  15.6  45.6  38.9 

5  30.0  54.0  16.0 

6  55.3  44.0  0.7 

7  47.5  51.7  0.8 

8  14.0  73.3  12.7 


5TON  all  lens  types  (field)  vs.  all  subject  (lab) 


5TON  all  lens  types  (field)  vs.  all  subject  (lab) 


Correlation  value:  0.0 


3)  Vehicle  ID  rate  comparison  at  different  distance 


I  n  tcmmuifM  w.iwmmr.wm  myJrM  B-f-fcM  KHE1  w&xm  **m  m+-#m  fct  :*«■  tora  I 


Lab  5Ton 


AAV 


HMMWV 


LAV 


M1A1 


Correlation  (field  vs.  lab) 


HEJjlEJj  ESI  EU  ESDI  EOE£IHIil 
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i»TiyigiiinitaiEaESiE£lEa^BEaEI3EgE!aE21EaEai— I 
(^^•lEOiEOli^BiEHiEilllEElEiSlEElESHEZilBMIEIlIlElIilEEl^Hill 


The  one  with  best  correlation  value  is  at  distance  1  (600  -  900  meters) 


%ID  com  parison  at  distance  1 


%ID+DET  com  parison  at  distance  1 


5Ton  AAV  HMMWV  LAV  M1A1 
— ♦ — Field  — ■ — Lab 

Correlation  value:  %  ID  -  0.7 

5)  ID  rate  comparison  of  different  vehicles 

a)  Comparison  with  all  subject  data 


1  [  -T“ y  wraari 


5Ton  AAV  HMMWV 
— * —  Field 


%ID+DET  -  0.9 


53.6  18.1  28.3 


54.1  14.5  31.3  36.1 


l|2l£y^MMIK£2[lEiEflB£2il  ^£IK££1KL£1 1 


All  lens  type  (field)  vs.  all  subject 


All  lens  type  (field)  vs.  all  subject 


Correlation  value: 

Subj.  1-9:  %  ID -0.61  %ID  +  DET  -  0.95 

Subj.  10-30:  %  ID -0.17  %ID  +  DET  -  0.95 


c)  Comparison  with  20/20  vision  and  better  than  20/20  vision 


kav-amEtm^ 

iagiaiiiBBWfflw.ii^Ml 

£3!BI 

KfiUM 

m-wu 

mz*tu 

m-i-r-m 

u&*m 

AAV 

36.7 

52.9 

10.4 

■cTfltJ 

LAV 

maim 

12.5 

1^1 

33.0 

47.7 

■  KM 

ishwawii^} 

BUI 

22.5 

■tllM 

ES! 

ID  rate  comparison 


— ♦ —  Field 

— ■ —  20/20  vision 

— A — Better  than  20/20 

ID  +  DET  rate  comparison 


Ml  A 1  AAV  LAV  5TON  HMMWV 
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Correlation  value: 

Subj.  20/20:  %  ID  -  0.23 

Subj.  better  than  20/20  :  %  ID -0.21 


%ID  +  DET  -  0.95 
%ID  +  DET  -  0.94 


d)  Comparison  with  normal  vision  and  corrected  vision 


Normal  vision 

Corrected  vision 

Vehicle 

%ID 

%DET 

%Un 

5S1D 

%DET 

%UN 

MTOT 

30.3 

51 .0 

18.8 

26.1 

47.1 

"26.6 

MV 

32.1 

-'60.4 

7.4 

“srr 

54.9 

MV 

27.2 

57.7 

15.1 

40.5 

51.0 

8.5 

5TDN 

36.1 

49.6 

14.3 

36.0 

50.6 

13.5 

HMMWV 

28.2 

24.1 

47.8 

33.7 

21.6 

44.8 

Correlation  value: 

Subj.  normal  vision  :  %  ID  -  0.42  %ID  + DET -0.95 

Subj.  corrected  vision  :  %  ID -0.01  %ID  +  DET  -  0.91 


e)  Comparison  with  normal  color  vision  and  color  blindness 
(note:  only  2  data  sets  are  available  for  the  colorblind  data) 


|  Normal  color 

|  Color  blind 

Vehicle 

%ID 

%DET 

%UN 

35TD 

%DET 

%UN  1 

29.4 

48.5 

22.1 

23.5 

67.6 

~5 T~ 

MV 

32.1 

59.8 

8.0 

50.0 

43.8 

"  6.3 

LAV 

32.4 

54.2 

13.4 

14.7 

76.5 

8.8 

5T75R 

34.8 

50.9 

14.3 

"53.9 

35.5 

10.5 

HMMWV 

29.0 

23.9 

47.1 

41.4 

15.7 

42.9 

ID  rate  comparison 


— Field  — u — Normal  color  — * — Colorblind 


Ml  A 1  AAV  LAV  5TON  HMMWV 


Correlation  value: 


Subj.  normal  color  vision  :  %  ID  -  0.54  %ID  +  DET  -  0.94 

Subj.  color  blindness:  %  ID- -0.12  %ID  + DET -0.98 


CONCLUSIONS 

35mm  color  slides  were  used  from  another  field  test  to  help  validate  the  overall  test  procedures  used  in 
the  Visual  Perception  Laboratory  (VPL).  The  color  slides  were  of  seven  military  vehicles  positioned  at  tactical 
range  in  the  desert.  The  correlation  of  the  laboratory  to  the  field  ranged  from  0.5  to  0.95  depending  on  the 
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variables  analyzed  and  questions  asked  of  the  subjects.  The  highest  correlation,  09.5,  was  obtained  when 
comparing  identification  rates  of  the  vehicles  between  the  field  and  the  lab.  This  is  understandable  in  light  of 
the  fact  that  detection  is  strongly  controlled  by  local  luminance  conditions,  which  are  hard  to  replicate  in  the  lab, 
and  identification  rates  are  more  a  function  of  the  target  size,  shape,  texture  and  target/background  color 
differences,  which  are  easily  replicated  in  the  lab  using  various  projection  techniques.  Bottom  line,  the  VPL  can 
give  results  that  correlate  almost  perfectly  to  the  field  if  the  correct  questions  are  asked. 

Overall,  the  lower  luminance  in  the  VPL  of  the  projected  image  resulted  in  a  lower  identification  rate 
and  higher  detection  rate  than  the  field  test.  This  study  shows  that  the  vehicle  identification  rate  aggregated  by 
the  distance  gives  the  best  correlation. 


REFERENCE 

1)  Ground  Laser  Eye  Protection  System  (GLEPS)  for  Armored  Vehicle  Crews  test  report,  United  States  Marine 
Corps,  Marine  Corps  Systems  Command  Quantico,  VA.  22134-5080;  January  25,  1994 


11 


